Photography session assistant

ABSTRACT

Devices and methods for conducting a remote photography session are described. In some instances, a computing device at a photography station receives messages from a photography station controller which is remote from the photography station. In some examples, the computing device receives one or more messages instructing the computing device to capture an image from an image capture device. The computing device can also receive one or more messages instructing the computing device to adjust the image capture device. Additionally, the messages may instruct the computing device to present instructions to a subject of the photography session. These instructions can prompt the subject to make adjustments to meet a criteria for a photograph in the photography session.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a continuation-in-part of U.S. application Ser. No.17/070,729, filed on Oct. 14, 2020, entitled PHOTOGRAPHY SESSIONASSISTANT, which is a continuation of U.S. patent application Ser. No.16/386,918, filed on Apr. 17, 2019, issued as U.S. Pat. No. 10,839,502on Nov. 17, 2020, entitled PHOTOGRAPHY SESSION ASSISTANT, thedisclosures of which are hereby incorporated by reference in theirentireties. To the extent appropriate a claim of priority is made toeach of the above-identified applications.

BACKGROUND

Professional photography sessions can be performed at a professionalstudio, or on-site at churches, schools, etc. During a professionalphotography session, the photographer must manage the session in orderto capture a set of images having certain requirements. The requirementscan include different image cropping, facial expressions, poses, etc.,to ensure that the session results in a set of images for the customerto choose from that fits the customer's desired order package. To makesure that the session results in an adequate set of images,photographers may manage the session to proceed in a specified order.

One difficulty is that, for a variety of reasons, photographers do notalways follow the specified order. In addition, photographers aretypically busy engaging the subject, and do not have time to carefullyanalyze and critique each image. Therefore, it is often difficult forthe photographer to determine if a set of images taken during aphotography session contains images that satisfy the requirements forall of the required photographs for the session while the session isstill active and the subject, or subjects, are still present in order tocapture more images if needed.

Another difficulty is that for each of the required photographs,multiple images are often taken. For example, for a particular requiredphotograph (e.g. image cropping, pose, expression), multiple images maybe taken for the photographer to determine the correct lighting andexposure settings, and also multiple images may be taken to ensure thatthe subject is not blinking, looking away, half-smiling, etc. As such,the set of images from the session may be quite large and include manyimages that do not satisfy the requirements. The large number of imagescan also get in the way of determining whether photographs that satisfythe requirements have been captured with the required level of qualityto be considered for inclusion in an order package. In addition, thelarge number of images often makes it difficult and time consuming tochoose the photographs to include in an order package from the set ofimages taken during the session.

If a session does not result in an adequate set of images to fulfill anorder package at the end of a photography session, a new session, e.g. amake-up session, has to be scheduled. Scheduling a new, or make-up,session increases costs and the time burden on both the photographer andcustomer.

SUMMARY

In general terms, this disclosure is directed to conducting a remotephotography session. In some embodiments, and by non-limiting example, acomputing device at a photography station receives messages from aphotography station controller to capture one or more photographs froman image capture device. Additionally, these messages can adjust theimage capture device or present instructions to a subject of thephotography session. In many embodiments, the photography stationcontroller is remote from the photography station.

One aspect is a method of instructing and capturing at least onephotograph during a remote photography session at a photography stationis disclosed. The method comprising establishing a communication channelwith a computing device of a remote photography station. Where theremote photography station further includes an image capture device. Themethod further comprising receiving live images of the remotephotography station from the computing device, generating and sending atleast one message to the computing device over the communicationchannel. The at least one message instructing the computing device tocapture an image from the image capture device.

In another aspect a system for capturing at least one photograph duringa remote photography session is disclosed. The system comprising aphotography station controller including a first computing device and aphotography station remote from the photography station controller. Thephotography station controller includes a second computing device and animage capture device. Where the first computing device includes anon-transitory storage medium and at least one processor. Thenon-transitory storage medium storing instructions that, when executedby the at least one processor, cause the first computing device toestablish a communication channel with the second computing device,receive from the second computing device over the communication channellive images, and send at least one message to the second computingdevice over the communication channel. Where the at least one messageinstructs the second computing device to capture an image from the imagecapture device.

In a further aspect a non-transitory computer readable storage mediumstoring instructions for remotely conducting a photography session at aphotography station is disclosed. When the instructions are executed bya processor, the instructions cause the processor to establish acommunication channel with a computing device of the remote photographystation. Where the remote photography station includes a camera. Theinstructions further cause the processor to receive live images of theremote photography station over the communication channel and send atleast one message to the computing device over the communicationchannel. The at least one message instructs the computing device tocapture an image from the image capture device.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic block diagram illustrating an example photographysystem including a session assistant.

FIG. 2 is a schematic diagram of an example of a photography station.

FIG. 3 is a schematic diagram of an example of a mobile photographysystem.

FIG. 4 illustrates an exemplary architecture of a computing device thatcan be used to implement aspects of the present disclosure, includingany of the plurality of computing devices described herein.

FIG. 5 is a schematic block diagram of an example photography portraitorder specification.

FIG. 6 is a schematic block diagram of an example photography sessionstatus report.

FIG. 7 is a schematic block diagram of another example photographysession status report.

FIG. 8 is a schematic block diagram of a graphical user-interface screenfor determining whether an image qualifies as a required photograph.

FIG. 9 is a schematic block diagram of a session assistant.

FIG. 10 is a flow chart illustrating an example method of automaticallyevaluating and suggesting photographs during a photography session.

FIG. 11 is a schematic diagram of example required photographs capturedduring a photography session for a particular photography portrait orderspecification.

FIG. 12 is a schematic diagram of example required photographs capturedduring a photography session for a particular photography portrait orderspecification.

FIG. 13 is a schematic diagram illustrating an example remotephotography system.

FIG. 14 is a schematic diagram illustrating an example photographystation.

FIG. 15 is a schematic block diagram of an example camera.

FIG. 16. is a schematic diagram of an example lighting controller.

FIG. 17 is a schematic diagram illustrating a camera adjuster.

FIG. 18 is a schematic diagram illustrating an example remotephotography system.

FIG. 19. is an example user-interface for a remote photographer.

FIG. 20. is an example user-interface for a remote photographer.

FIG. 21 is an example user-interface for a photography station.

FIG. 22 is a schematic diagram illustrating an example remotephotography system.

FIG. 23 is a schematic diagram illustrating an example remotephotography system.

FIG. 24 is a schematic diagram illustrating an example remotephotography system.

FIG. 25 is a schematic diagram illustrating an example remotephotography system.

FIG. 26 is a flow chart illustrating an example method of conducting aremote photography session.

FIG. 27 is a flow chart illustrating an example method of running aphotography session using a photography station controller.

DETAILED DESCRIPTION

Various embodiments will be described in detail with reference to thedrawings, wherein like reference numerals represent like parts andassemblies throughout the several views. Reference to variousembodiments does not limit the scope of the claims attached hereto.Additionally, any examples set forth in this specification are notintended to be limiting and merely set forth some of the many possibleembodiments for the appended claims.

FIG. 1 is a schematic diagram illustrating an example photography system100. In this example, the photography system 100 includes a camera 102and a session assistant 104. In the example shown, the session assistant104 includes a graphical user-interface 106 and an evaluator 108. Alsoshown in FIG. 1 are a photographer P, a subject S, an image 110, aportrait order specification 112, and a session status report 114.

In some embodiments, the photography system 100 can be used by aphotographer P during a photography session as a way to ensure that aportrait order specification 112 is completed. In some embodiments, acustomer can choose a particular photography package that includes a setof photographs having certain criteria, such as certain poses, sizes,facial expressions, crop lengths, etc. In other embodiments the portraitorder specification 112 can be chosen by any one or more of aphotographer P, a subject S, a customer, or some other entity toidentify a set of desired photographs to be captured during thephotography session. In some embodiments, a chosen photography packagecan be associated with a portrait order specification 112 that containsdata defining the criteria for the photographs in the photographypackage. In other embodiments, a photograph specification can be used inplace of the portrait order specification 112. The photographspecification is the same as or similar to the portrait orderspecification 112 described herein, except that it is not necessarilyassociated with an order, such as a particular photography package or aset of photographs that have been ordered. Similar to the portrait orderspecification 112, however, the photography specification can includecertain criteria for a set of photographs to be obtained, such ascertain poses, sizes, facial expressions, crop lengths, etc. Aphotograph specification can also contain data defining the criteria forthe set of photographs. In some embodiments, the photography system 100is used in the context of a professional photography studio having aphotography station, such as shown in FIG. 2. In other embodiments, thephotography system 100 is used in the context of mobile photography,such as shown in FIG. 3.

The photography system 100 includes the camera 102 and the sessionassistant 104. The camera 102 captures the image 110 for evaluation bythe session assistant 104. In some embodiments, the camera 102 isoperated by a photographer P and captures images of a subject S. Inother embodiments, the camera 102 can be operated by the subject S, suchas with a remote control or using a timer, or by another individual, orthe camera 102 can be programmed to operate automatically to capture theimage 110. The camera 102 is typically a digital camera, although a filmcamera could also be used in another embodiment. If film cameras areused, the resulting prints are typically scanned by a scanner deviceinto digital form for subsequent processing by the session assistant104. The camera 102 can be a still or video camera. The resultingdigital images 110 are at least temporarily stored in computer readablestorage medium, which are then transferred to the session assistant 104.The transfer can occur across a data communication network (such as theInternet, a local area network, a cellular telephone network, or otherdata communication network), or can occur by physically transferring thecomputer readable storage medium containing the images (such as bypersonal delivery or mail) to the session assistant 104.

In some embodiments, the session assistant 104 operates to interact withthe photographer via the graphical user-interface 106 for selecting theportrait order specification 112, evaluate the image 110 based at leastin part on the portrait order specification 112, and indicate whetherthe image 110 satisfies the criteria of any of the required photographsin the portrait order specification 112. Examples of the sessionassistant 104 are illustrated and described in more detail herein withreference to FIG. 9.

The session assistant 104 generates a graphical user-interface (GUI) 106for interacting with a photographer, or a user. The graphicaluser-interface 106 can receive input via the GUI, for example, theselection of the portrait order specification 112 from a database ofportrait order specifications, and can display outputs, such as thesession status report 114. Examples of the graphical user-interface 106are illustrated and described in more detail herein with reference toFIG. 9, and examples of the session status report 114 are illustratedand described in more detail herein with reference to FIGS. 6-7.

In some embodiments, the evaluator 108 can determine if the image 110satisfies the criteria for one of the required photographs in theportrait order specification 112. Examples of the evaluator 108 areillustrated and described in more detail herein with reference to FIG.9.

The portrait order specification 112 can include a set of requiredphotographs and a set of required criteria for each of the requiredphotographs. Examples of the portrait order specification 112 areillustrated and described in more detail herein with reference to FIG.5.

FIG. 2 is a schematic block diagram of an example of a photographystation 120. The photography station 120 is an example of thephotography system 100, shown in FIG. 1. In the example shown, thephotography station 120 includes a camera 102, a computing device 142, acontroller 144, foreground lights 152, background lights 154, and abackground 156. In some embodiments, the photography station 120 furtherincludes a handheld control (not shown) for use by a photographer P. Thehandheld control can include a capture button, for example, that ispressed by the photographer P to initiate the capture of an image of asubject S with the camera 102, and in some cases, the capture of animage is coordinated with flash lighting.

The photography station 120 operates to capture one or more images 110of one or more subjects S, and can also operate to collect additionalinformation about the subgroup, such as body position data. In someembodiments, the photography station 120 is controlled by a photographerP, who interacts with the subject S to guide the subject S to a goodexpression, pose, etc., for satisfying the criteria required in theportrait order specification 112. The photograph P can also indicate tothe photography station 120 when an image 110 should be captured.

The camera 102 operates to capture digital images of the subject S. Thecamera 102 is typically a professional quality digital camera thatcaptures high quality images.

In some embodiments, data from the camera 102 is supplied to a computingdevice 142. An example of a computing device is illustrated anddescribed in more detail with reference to FIG. 4.

The computing device 142 can be directly or indirectly connected to thecamera 102 to receive digital data. Direct connections include wiredconnections through one or more communication cables, and wirelesscommunication using wireless communication devices (e.g., radio,infrared, etc.). Indirect connections include communication through oneor more intermediary devices, such as a controller 144, othercommunication devices, other computing devices, a data communicationnetwork, and the like. Indirect connections include any communicationlink in which data can be communicated from one device to anotherdevice.

In some embodiments, the computing device 142 can include the sessionassistant 104. In such embodiments, the computing device 142 and camera102 form the hardware implementation of the photography system 100. Thecomputing device 142 can include a display which can display thegraphical user-interface 106 GUI for the photography P to select theportrait order specification 112 for the photography session, and whichcan display the session status report 114 to update the photographer Pregarding progress being made in completing the portrait orderspecification 112 during the photography session.

Some embodiments further include a controller 144. The controller 144operates, for example, to synchronize operation of the camera 102 withthe foreground lights 152 and the background lights 154. Synchronizationcan alternatively be performed by the computing device 142 in someembodiments.

Some embodiments further include a data input device, such as a barcodescanner, which can be integrated with the handheld control, or aseparate device. The barcode scanner can be used to input data into thephotography station 120. For example, a subject S can be provided with acard containing a barcode. The barcode is scanned by the data inputdevice to retrieve barcode data. The barcode data includes, or isassociated with, subject data, such as metadata 292 that identifies thesubject S. The barcode data can also include or be associated withadditional data, such as order data (e.g., a purchase order for productsmade from the images), group affiliation data (e.g., identifying thesubject S as being affiliated with a school, church, business, club,sports team, etc.), or other helpful information. The computing device142 can alternatively, or additionally, operate as the data input devicein some embodiments. For example, a user such as the photographer P, maydirectly enter data via the keyboard, mouse, or touch sensor of thecomputing device 142, such as order data, group affiliation data, ordata associated with the photography session, the portrait orderspecification 112, or data associated with an image 110. In someembodiments, a photographer can enter notes or other data regarding therequired criteria that the particular image 110 is intended to capturesuch as pose, facial expression, crop length, included props, imageorientation, etc.

In the example shown, the photography station 120 includes backgroundlights 154. In some embodiments, a single background light 154 isincluded. The background lights can include one or more light sources,such as incandescent bulbs, fluorescent lamps, light-emitting diodes,discharge lamps, and the like. The background lights 154 are arrangedand configured to illuminate the background 156. In some embodiments thebackground lights 154 are arranged at least partially forward of thebackground 156, to illuminate a forward facing surface of the background156. In other embodiments, the background lights 154 are arranged atleast partially behind the background, to illuminate a translucentbackground 156 from behind.

In some embodiments, the photography station 120 includes foregroundlights 152. In some embodiments, a single foreground light 152 isincluded. The foreground lights 152 can include one or more lightsources, such as incandescent bulbs, fluorescent lamps, light-emittingdiodes, discharge lamps, and the like. The foreground lights 152 caninclude multiple lights, such as a main light and a fill light. Each ofthese lights can include one or more light sources.

The foreground lights 152 are arranged at least partially forward of thesubject S to illuminate the subject S while an image 110 is being taken.Because a background 156 is typically positioned behind the subject S,the foreground lights 152 can also illuminate the background 156.

The photography station 120 can include a background 156. The background156 is typically a sheet of one or more materials that is arrangedbehind a subject S while an image 110 of the subject S is captured. Insome embodiments the background 156 is translucent, such that at leastsome of the light from the background light 154 is allowed to passthrough. An example of a suitable material for the background 156 is arear projection screen material. Other embodiments illuminate thebackground 156 from the front (but behind the subject S), such thatbackground 156 need not be translucent. An example of a suitablematerial for the background 156, when front illumination is used, is afront projection screen material. In some embodiments, the background156 is of a predetermined color and texture and specified in theportrait order specification 112 as part of the criteria for a set ofrequired photographs.

FIG. 3 is a schematic diagram of an example of a mobile photographysystem 170. The mobile photography system 170 is another example of thephotography system 100, shown in FIG. 1. In the example shown, themobile photography system 170 includes a camera 102, and computingdevice 146, a session assistant 104 including a graphical user-interface106 and evaluator 108, a session status report 114, a photographer P,and a subject S. The example in FIG. 3 also includes the sessionassistant 104, which includes the graphical user-interface 106 and theevaluator 108.

In the embodiment shown, the computing device 146 is a mobile device,such as a smartphone, and the camera 102 is a digital camera integratedwith the computing device. In some embodiments, the subject S can alsobe the photographer P, for example, when taking a self-image, or“selfie.”

In the embodiment shown, the computing device 146 includes the sessionassistant 104, which includes the graphical user-interface 106 and theevaluator 108. As such, by including both the camera 102 and the sessionassistant 104, the computing device 146 forms the hardwareimplementation of the photography system 100 in the example shown. Thecomputing device 146 can include a display which can display thegraphical user-interface 106 GUI for the photographer P to select theportrait order specification 112 for the photography session, and whichcan display the session status report 114 to update the photographer Pregarding progress being made in completing the portrait orderspecification 112 during the photography session. An example of acomputing device 146 is illustrated and described in more detail withreference to FIG. 4.

In some embodiments, the session assistant 104 can be implemented onseparate hardware. For example, the session assistant 104 can be anapplication on the computing device 146 that is configured to displaythe GUI 106, receive a selection of the portrait order specification112, and acquire the image 110, while the evaluator 108 can reside on aremote server. The image 110 and portrait order specification 112 canthen be uploaded to the evaluator 108 on the remote server via anetwork, such as the Internet, which can then send results back to thecomputing device for display through the graphical user-interface 106.

FIG. 4 illustrates an exemplary architecture of a computing device thatcan be used to implement aspects of the present disclosure, includingany of the plurality of computing devices described herein. Thecomputing device illustrated in FIG. 4 can be used to execute theoperating system, application programs, and software described herein.By way of example, the computing device will be described below as thecomputing device 142 of the photography station 120, shown in FIG. 2. Toavoid undue repetition, this description of the computing device willnot be separately repeated herein for each of the other computingdevices, including the computing devices 142 and 146, but such devicescan also be configured as illustrated and described with reference toFIG. 4.

The computing device 142 includes, in some embodiments, at least oneprocessing device 180, such as a central processing unit (CPU). Avariety of processing devices are available from a variety ofmanufacturers, for example, Intel or Advanced Micro Devices. In thisexample, the computing device 142 also includes a system memory 182, anda system bus 184 that couples various system components including thesystem memory 182 to the processing device 180. The system bus 184 isone of any number of types of bus structures including a memory bus, ormemory controller; a peripheral bus; and a local bus using any of avariety of bus architectures.

Examples of computing devices suitable for the computing device 142include a desktop computer, a laptop computer, a tablet computer, amobile computing device (such as a smartphone, an iPod® or iPad® mobiledigital device, or other mobile devices), or other devices configured toprocess digital instructions.

The system memory 182 includes read only memory 186 and random accessmemory 188. A basic input/output system 190 containing the basicroutines that act to transfer information within computing device 142,such as during start up, is typically stored in the read only memory186.

The computing device 142 also includes a secondary storage device 192 insome embodiments, such as a hard disk drive, for storing digital data.The secondary storage device 192 is connected to the system bus 184 by asecondary storage interface 194. The secondary storage devices 192 andtheir associated computer readable media provide nonvolatile storage ofcomputer readable instructions (including application programs andprogram modules), data structures, and other data for the computingdevice 142.

Although the exemplary environment described herein employs a hard diskdrive as a secondary storage device, other types of computer readablestorage media are used in other embodiments. Examples of these othertypes of computer readable storage media include magnetic cassettes,flash memory cards, digital video disks, Bernoulli cartridges, compactdisc read only memories, digital versatile disk read only memories,random access memories, or read only memories. Some embodiments includenon-transitory media, such as a non-transitory computer readable medium.Additionally, such computer readable storage media can include localstorage or cloud-based storage.

A number of program modules can be stored in secondary storage device192 or memory 182, including an operating system 196, one or moreapplication programs 198, other program modules 200 (such as thesoftware described herein), and program data 202. The computing device142 can utilize any suitable operating system, such as MicrosoftWindows™, Google Chrome™, Apple OS, and any other operating systemsuitable for a computing device. Other examples can include Microsoft,Google, or Apple operating systems, or any other suitable operatingsystem used in tablet computing devices.

In some embodiments, a user provides inputs to the computing device 142through one or more input devices 204. Examples of input devices 204include a keyboard 206, mouse 208, microphone 210, and touch sensor 212(such as a touchpad or touch sensitive display). Other embodimentsinclude other input devices 204. The input devices are often connectedto the processing device 180 through an input/output interface 214 thatis coupled to the system bus 184. These input devices 204 can beconnected by any number of input/output interfaces, such as a parallelport, serial port, game port, or a universal serial bus. Wirelesscommunication between input devices and the interface 214 is possible aswell, and includes infrared, Bluetooth® wireless technology,802.11a/b/g/n, cellular, or other radio frequency communication systemsin some possible embodiments.

In this example embodiment, a display device 216, such as a monitor,liquid crystal display device, projector, or touch sensitive displaydevice, is also connected to the system bus 184 via an interface, suchas a video adapter 218. In addition to the display device 216, thecomputing device 142 can include various other peripheral devices (notshown), such as speakers or a printer.

When used in a local area networking environment or a wide areanetworking environment (such as the Internet), the computing device 142is typically connected to the network through a network interface 220,such as an Ethernet interface. Other possible embodiments use othercommunication devices. For example, some embodiments of the computingdevice 142 include a modem for communicating across the network.

The computing device 142 typically includes at least some form ofcomputer readable media. Computer readable media includes any availablemedia that can be accessed by the computing device 142. By way ofexample, computer readable media include computer readable storage mediaand computer readable communication media.

Computer readable storage media includes volatile and nonvolatile,removable and non-removable media implemented in any device configuredto store information such as computer readable instructions, datastructures, program modules or other data. Computer readable storagemedia includes, but is not limited to, random access memory, read onlymemory, electrically erasable programmable read only memory, flashmemory or other memory technology, compact disc read only memory,digital versatile disks or other optical storage, magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other medium that can be used to store the desired informationand that can be accessed by the computing device 142.

Computer readable communication media typically embodies computerreadable instructions, data structures, program modules or other data ina modulated data signal such as a carrier wave or other transportmechanism and includes any information delivery media. The term“modulated data signal” refers to a signal that has one or more of itscharacteristics set or changed in such a manner as to encode informationin the signal. By way of example, computer readable communication mediaincludes wired media such as a wired network or direct-wired connection,and wireless media such as acoustic, radio frequency, infrared, andother wireless media. Combinations of any of the above are also includedwithin the scope of computer readable media.

The computing device illustrated in FIG. 4 is also an example ofprogrammable electronics, which may include one or more such computingdevices, and when multiple computing devices are included, suchcomputing devices can be coupled together with a suitable datacommunication network so as to collectively perform the variousfunctions, methods, or operations disclosed herein.

FIG. 5 is a schematic block diagram of an example portrait orderspecification 112. In the example shown, the portrait orderspecification 112 is organized in a row-column spreadsheet format, andincludes a portrait order specification name 250, a list 252 of requiredphotographs 256, and a list 254 of required criteria 258. As shown, thelist 252 includes required photographs 256 a-n, where n can be thenumber of required photographs in the list 252. Also as shown, the list254 includes required criteria 258 a-n. In some embodiments, theportrait order specification 112 can be a data set organized in anysuitable manner.

In some embodiments, the portrait order specification 112 has a uniqueidentifier or portrait order specification name 250. A plurality ofportrait order specifications 112 can be stored, such as in memory on acomputing device 142, and each can have a unique identifier or portraitorder specification name 250 to assist a photographer P in selecting aportrait order specification containing a desired set of requiredphotographs 256.

As shown in the example, the required photographs 256 are associatedwith the required criteria 258. For example, the required photograph 256a is associated with the required criteria 258 a, the requiredphotograph 256 b is associated with the required criteria 258 b, and therequired photograph 256 c is associated with the required criteria 258c. In some embodiments, different required photographs 256 can beassociated with required criteria 258 having different criteria, anddiffering numbers of criteria items. For example, FIG. 5 illustratesrequired photograph 256 a associated with required criteria 258 a whichhas four criteria items listed: crop, facial expression,vertical/horizontal image orientation, and pose. FIG. 5 illustratesrequired photograph 256 b associated with required criteria 258 b whichhas two criteria items listed: crop, and facial expression. FIG. 5 alsoillustrates required photograph 256 c associated with required criteria258 c which has three criteria items listed: crop, facial expression,and pose. In some embodiments, the portrait order specification 112 mayhave fewer or more required photographs 256 than shown in FIG. 5,illustrated as required photograph 256 n, and the associated requiredcriteria 258 may have fewer or more required criteria items, anddiffering criteria items, than are shown in FIG. 5, as illustrated byrequired criteria 258 n.

In some embodiments, the required criteria 258 associated with arequired photograph 256 designate features that the required photographincludes. As such, the image 110 must include the features designated bythe required criteria 258 in order for that image 110 to qualify as therequired photograph 256. By way of example, in the portrait orderspecification 112 illustrated in FIG. 5, an image 110 taken during aphotography session must include the designated crop (e.g. close up,full length, half length, etc.), and facial expression (e.g. full smile,soft smile, game face, etc.) as specified by the required criteria 258 bin order for it to qualify as the required photograph 256 b in theportrait order specification 112. In some embodiments, the evaluator 108determines whether the image 110 includes such features. In someembodiments, the photographer P determines whether the image 110includes such features. For example, the session assistant 104 canindicate to the photographer P whether the image 110 includes featuresassociated with the required criteria 258 for at least one of therequired photographs 256 in the portrait order specification 112 via asession status report 114 displayed in a graphical user-interface 106,and the photographer P determines whether the image 110 includes suchfeatures and can provide input, for example, by selecting that the image110 satisfies the required criteria 258 for one more requiredphotographs 256 via user input mechanisms of the graphicaluser-interface 106.

As described above with respect to FIG. 1, a photograph specificationcan alternatively be used in place of the portrait order specification112 described herein. The photograph specification can contain, forexample, data defining the criteria for a set of desired photographs. Insome embodiments, a photograph specification specifies a group photoincluding a number of subjects at one or more scenes or locations, forexample in a mobile photography context, as illustrated in FIG. 3. Thephotographer P may take a larger number of photos at each scene in amobile photography session as compared to a photography session in aphotography studio or at a photography station. For example, thelighting conditions in a mobile photography context may not be as wellcontrolled as in a studio or station, and a large number of images mayneed to be taken to in order to satisfy the required criteria 258 of thephotograph specification. In some embodiments, a photographspecification can be chosen by the photographer P, the subject orsubjects S, or by some other user of the session assistant 104. In someembodiments, the photograph specification contains default requiredcriteria 258, for example, a facial expression (e.g. smiling, eyes openand not blinking or winking, etc.), crop (e.g. close up, full length,half length, subject or subjects S located in a certain portion of theimage, etc.), pose (e.g. sitting, standing, running, jumping, etc.),image quality (e.g. sharp and not blurry), etc. In other embodiments,the required criteria 258 for the set of required photographs are chosenby the photographer P, the subject or subjects S, or some other user ofthe session assistant 104. In still other embodiments, the photographerP, or subject S, or other user, can define new or additional requiredcriteria 258.

Each of the components of the exemplary session status report will bediscussed below with reference to both FIGS. 6-7 concurrently.

FIGS. 6-7 are schematic block diagrams of example photography sessionstatus reports 114. The examples shown in FIGS. 6-7 include sessionstatus report 114. The examples shown also includes a list 252 ofrequired photographs 256, a list 254 of required criteria 258, a list260 of indicators 268 a-n, a list 262 of image previews 270 a-n, a list264 of image identifiers 272 a-n, and a list 266 of image rankings 274a-n. The example shown in FIG. 6 illustrates a session status report 114where no image 110 is associated with any required photograph 256, whichcan occur, for example, at the beginning of a photography session. Theexample shown in FIG. 7 illustrates a session status report 114indicating several images 110 that are associated with at least onerequired photograph 256.

In the examples shown in FIG. 6, the session status report 114 isorganized as a row-column spreadsheet for display, such as in thegraphical user-interface 106. The session status report 114 can displaythe portrait order specification 112 data, e.g. the list 252 of requiredphotographs 256 and the list 254 of required criteria 258 in analogouscolumns as that illustrated in FIG. 5. The session status report 114 canalso display the portrait order specification name 250 of the selectedportrait order specification 112.

In some embodiments, the list 260 of indicators 268 a-n give visualfeedback as to whether an image 110 that has been taken during aphotography session satisfies the required criteria 258 and thereforequalifies as a required photograph 256. In the example shown in FIG. 7,the indicators 268 a, n are blank checkboxes indicating that there is noimage 110 that qualifies as required photographs 256 a, n, and theindicators 268 b, c are checked checkboxes indicating that at least oneimage 110 qualifies as required photographs 256 b, c. Other indicatorscan be used as indicators 268 a-n, for example, color highlighting of aspreadsheet cell, text indicating yes or no, etc. In some embodiments,the indicators 268 can be configured to receive input, for example, aphotographer P can click on, touch, or use other input mechanisms toactivate a checkbox 268 such that it is checked or deactivate a checkbox268 such that it is unchecked. In some embodiments, the presence of animage preview 270 or an image identifier 272 can give visual feedback asto whether an image 110 is associated with a required photograph 256,and the indicators 268 can receive input, e.g. from the photographer P,that an image 110 satisfies the required criteria 258 of a requiredphotograph 256 and therefore qualifies as the required photograph 256.In other embodiments, the indicators 268 can be automatically activated,such as when an image 110 is automatically evaluated and determined tosatisfy the required criteria 258 of a required photograph, for exampleby the evaluator 108.

In some embodiments, the list 262 of image previews 270 a-n give visualfeedback that an image 110 is associated with a required photograph 256.As shown in the example in FIG. 7, if there are more than one image 110that are associated with a required photograph 256, the image preview270 can be a thumbnail image representing one of the associated images110. In some embodiments, an image 110 can be associated with more thanone required photograph 256.

In some embodiments, the list 264 of image identifiers 272 a-n includesunique identifiers for the images 110 that are associated with requiredphotographs 256. In some examples, the unique identifier is the filenameof the digital file in which the image 110 is stored, which can includea file path for determining the storage location of the digital file. Insome embodiments, more than one image identifier can be displayed formore than one image 110 that is associated with a required photograph256. In the example shown in FIG. 7, three images 110 are associatedwith the required photograph 256 b, corresponding to three imageidentifiers 272 b and the checkboxes 268 b, and one image 110 isassociated with the required photograph 256 c, corresponding to oneimage identifier 272 c and the checked checkbox 268 c. FIG. 7 also showsthat there are no images 110 as associated with the required photographs256 a, n, corresponding to the unchecked checkboxes 268 a, n, no imagepreviews 270 a, n appearing in the list 262, and no image identifiers272 a, n appearing in the list 264.

In some embodiments, the list 266 includes image rankings 274 a-n forthe images 110 that qualify as required photographs 256. In someembodiments, an image 110 as associated with a required photograph 256is only ranked against other images 110 as associated with the samerequired photograph 256. For example, as shown in FIG. 7, the threeimages 110 as associated with the required photograph 256 b in theModern Studio portrait order specification 112 include numeric rankings274 b of 1-3, in a top-to-bottom order, as displayed in the list 266 ofthe Modern Studio session status report 114. In the example shown, the1-3 rankings are displayed at the same row height as the correspondingimage identifiers 272 b to indicate which image 110 corresponds to whichranking.

In some embodiments, the image rankings 274 are based on a requiredlevel of quality. In some embodiments, the required level of quality isdetermined by whether the image 110 includes features associated withcertain required criteria items, e.g. the level of quality can be on abinary scale. For example, for a required photograph 256 requiring aportrait orientation, the level of quality for an image 110 that is aportrait image would be 100%, or 1, or “yes,” etc., as to thatorientation criteria, and an image 110 that is a landscape image wouldbe 0%, or 0, or “no,” etc., as to that orientation criteria. In someembodiments, the level of quality may be on a continuous scale, forexample, for a required photograph 256 requiring a soft-smile facialexpression, the level of quality can be categorized into appropriatecategories depending on facial expression detection, or the level ofquality can be numeric representing the closeness of the facialexpression detected in the image 110 to a pre-determined, or expected,target soft-smile feature characteristics.

In some embodiments, a quality score for an image 110 can be determinedbased on an aggregation of levels of quality for all of the requiredcriteria items associated with a required photograph 256. For example,for a required photograph 256 having required crop, facial expression,and pose criteria, the quality score of an image 110 including featuresassociated with those required criteria can be determined by comparing,summing, or otherwise aggregating the levels of quality determined foreach of the image 110, crop, facial expression, and pose included. Insome embodiments, levels of quality for each individual requiredcriteria item can be weighted such that the quality score is determinedby a weighted aggregation.

Referring now to FIGS. 6-7 generally, in some embodiments, the sessionstatus report 114 can include fewer or more items. For example, in someembodiments, the session status report can display the quality score ofthe image 110 and the level of quality of the features within the image110.

FIG. 8 is a schematic block diagram of a graphical user-interface 106screen for determining whether an image 110 qualifies as a requiredphotograph 256. The example shown in FIG. 8 includes accept button 320,reject button 322, left scroll button 324, and right scroll button 326.The example shown also includes the image 110, the required photograph256 and associated required criteria 258, the image identifier 272 ofthe image 110, and the rank 274 of the image 110. In some embodiments,multiple photos that ranked the highest for a pose are displayed in oneview to allow fast review and confirmation by the photographer. In otherembodiments, multiple photos that ranked higher than a thresholdranking, or exceeded a threshold quality level or threshold qualityscore, for a pose, a crop, a facial expression, or other image featureor required criteria, are displayed in a single view to allow fastreview and confirmation by the photographer.

In some embodiments, the session GUI display 280 of the graphicaluser-interface 106 can display the image 110 in a screen configured toreceive inputs as to whether the image 110 satisfies the requiredcriteria 258 for a required photograph 256, such as inputs from thephotographer P. For example, an image 110 can be evaluated andassociated with a required photograph 256 by the evaluator 108, and animage preview 270 and image identifier 272 for the image 110 canpopulate the session status report 114. In some embodiments, the sessionstatus report 114 can be configured to receive a selection of the image110, for example by selecting the image preview 270 or image identifier272, and the session assistant 104 can process the selection so as todisplay screen illustrated in FIG. 8 in the session GUI display 280,allowing a larger view of the image 110. In some embodiments, thesession GUI display 280 is configured to receive input to digitally zoomand shift the image 110, thereby allowing a user, such as the photographP, to further view the image 110 at the desired level of detail.

In some embodiments, the accept button 320 is configured to receive aselection, such as by the photographer P, that the image 110 satisfiesthe required criteria 258 for the required photograph 256, and thesession assistant 104 can update the session status report 114 byactivating the indicator 268 associated with the required photograph256. In the example shown, if the photographer P selects the acceptbutton 320, the image 110 (e.g. P20190305075236) is designated asqualifying as the required photograph 256 b and the indicator 268 b-1can be checked, as illustrated in FIG. 7. It is noted that more than oneimage 110 can satisfy the required criteria 258 for one or more requiredphotographs 256, and as such, more than one image 110 can be acceptedvia the accept button 320 and be designated as qualifying as a requiredphotograph 256. In some embodiments, a selection of the accept button320 can override a previous determination that the image 110 does notsatisfy the required criteria 258.

In some embodiments, the reject button 322 is configured to receive aselection, such as by the photographer P, that the image 110 does notsatisfy the required criteria 258 for the required photograph 256, andthe session assistant 104 can update the session status report 114 bydeactivating the indicator 268 associated with the required photograph256. In some embodiments, a selection of the reject button 322 canoverride a previous determination that the image 110 satisfies therequired criteria 258 and qualifies as the required photograph 256,thereby disqualifying the image 110 as the required photograph 256.

In some embodiments, a selection of the accept button 320 or the rejectbutton 322 are equivalent to a user, such as the photograph P, checkingor unchecking, respectively, the indicator 268 in the session statusreport 114.

In some embodiments, the left scroll button 324 and right scroll button326 are configured to replace the image 110 and associated imageidentifier 272 and image rank 274 with a different image 110 andassociated image identifier 272 and image rank 274. In some embodiments,all of the images 110 captured during a photography session can beretrieved by the session assistant 104 for display in the session GUIdisplay 280 according to an order. A selection of the left and rightscroll buttons 324 and 326 allow the user, such as the photograph P, toscroll through and view the images 110 from the photography session.

In some embodiments, the session GUI display 280 can be configured toreceive a selection by the user, such as the photograph P, to change theassociation of the image 110 to a different photograph 256. For example,the photographer P can select the required photograph 256, e.g. Photo 2as illustrated in FIG. 8, and the graphical user-interface can beconfigured to display a list of the required photographs 256 to thephotographer P for selection by the photographer P as being associatedwith the image 110 being displayed, or the photographer P can select toremove any association of the image 110 with one or more requiredphotographs 256. The session status report 114 can then be updated toadd or remove the image 110 in the appropriate row according to thephotographer's P selection.

FIG. 9 is a schematic block diagram of a session assistant 104. In theexample shown, the session assistant 104 includes a graphicaluser-interface 106, an evaluator 108, and a data store 129. Also asshown in the example, the data store 129 includes in image database 290and a portrait order specification database 294.

As shown in the example, the graphical user-interface 106 includes thesession status report 114 and the session GUI display 280. In someembodiments, the graphical user-interface 106 is configured to receiveinput from a user, such as a photographer P. The input can consist of aselection to display a list of portrait order specifications 112 in thesession GUI display 280, and the input can also consist of a selectionof one of the portrait order specifications 112 for use, either during aphotography session or after a photography session as a check on whetherthe images 110 captured during a photography session completed theportrait order specification 112 by satisfying all of the requiredcriteria 258 in the portrait order specification 112. The input may bereceived through session GUI display 280 via an input mechanism of acomputing device, for example, a touch screen, keyboard, or mouse ofcomputing device 142 or 146. The session assistant 104 can include or bein communication with the evaluator 108 and the data store 129 so as tosend data from the data store, e.g. the image 110 from the imagedatabase 290 and the selected portrait order specification 112 from theportrait order specification database 294.

As shown in the example, the evaluator 108 includes a crop detector 302,a facial expression detector 304, an orientation detector 306, a posedetector 308, and an other image features detector 310. In someembodiments, the evaluator 108 is configured to receive images and data,such as the image 110 and data such as required criteria 258, determinewhether an image 110 can be associated with a required photograph 256 byidentifying and processing features included in the image 110. In someembodiments, the evaluator 108 can output whether the image 110 includesfeatures associated with the required criteria 258 and associated theimage 110 with one or more required photographs 256. In someembodiments, the evaluator 108 can determine the level of quality of theimage 110 relative to the required criteria 258, rank the image 110among multiple images 110 that associated with a particular requiredphotograph 256, and determine a quality score of the image 110 asdiscussed above with respect to FIG. 7.

In some embodiments, the crop detector 302 is configured to determinethe crop of the image 110. In some embodiments, crop, or alternativelyreferred to as crop length, (e.g. close up, full length, half-length,etc.), is the portion of the subject S that is visible in the image 110.The crop can be set by the field of the view of the camera 102, forexample by setting the focal length of a telephoto zoom lens of thecamera 102, or by physically moving the camera 102 closer or fartheraway from the subject S. The crop can also be set by selecting portionsof a full resolution image and resizing those portions to the desiredphysical dimensions, e.g. digital zoom. In some embodiments, croplengths can include extreme close up (zooming in to portions of thesubjects head or face), close up (including the head of the subject S),head and shoulders, half-length (including the head of the subject S tothe waist or belt line of the subject), three-quarter length (from thehead of subject S to around the knees of the subject), and full length(from the head to the feed of the subject S). In the example shown inFIG. 11, the required photograph 256 c illustrates an example head andshoulders crop, and the required photograph 256 f illustrates an examplethree-quarter length crop.

In some embodiments, the crop detector 302 determines the crop byreading the crop from metadata of the image 110. For example, the camera102 can include a telephoto zoom lens with electronics that can controlautofocus, auto zoom, and auto aperture functionality to control imagesharpness and resolution, magnification and field of view, and amount oflight collected by the lens. Such a lens may also directly sense orcontrol its focus, zoom (e.g. 18-55 mm, 75-300 mm, etc.), and aperture(F/2.8, F/4, F/16, etc.), or be in electronic communication with acamera body of camera 102 having electronics that control those lensparameters, or be in communication with a computing device 142 or 146,or a controller 144 that control focus, zoom, and aperture. In someembodiments, the lens settings (focus, zoom, aperture, etc.) when animage 110 is captured can be combined with the image 110 data in theimage data file as metadata 292, and stored in the image database 290 inthe data store 129.

In some embodiments, the crop detector 302 determines the crop of theimage 110 by using image analysis, such as determining face points andbody points of the subject S included in the image 110 via depth andposition detection. The details regarding depth and position detectioncan be found in U.S. patent application Ser. No. 13/777,579 entitled“Photography System with Depth and Position Detection”, which is herebyincorporated by reference.

In some embodiments, the facial expression detector 304 is configured todetermine a facial expression of one or more subjects S included in theimage 110. In some embodiments the facial expression detector 304determines the facial expression of the subject or subjects S includedin the image 110 by reading the facial expressions from metadata 292 ofthe image 110. For example, as described above in connection with FIG.1, a photographer P may input data via the computing device 142. Suchdata may include notes regarding an image 110 being captured, such asthe facial expression of the subject S during capture or the facialexpression of subject S intended to be captured to satisfy requiredcriteria 258. In some embodiments, input data may be associated with theimage 110 and stored as metadata 292.

In some embodiments, the facial expression detector 304 determines thefacial expression of the subject S included in the image 110 by usingimage analysis. As one example, facial expression detection can utilizethe technology described in the commonly assigned U.S. patentapplication Ser. No. 16/012,989, filed on Jun. 20, 2018 by one of thepresent inventors, titled A HYBRID DEEP LEARNING METHOD FOR RECOGNIZINGFACIAL EXPRESSIONS, the disclosure of which is hereby incorporated byreference in its entirety. In some embodiments, facial expressions caninclude full smile, half-smile, soft smile, no smile but happy, gameface, looking away, blink, etc. In some embodiments, facial expressiondetection includes detecting whether the subject included in the image110 is blinking, winking, has one or both eyes open or closed, orwhether the subject is looking at the camera or looking away. In theexample shown in FIG. 11, the required photograph 256 a illustrates anexample full smile, and the required photograph 256 c illustrates anexample soft smile.

In some embodiments, the orientation detector 306 is configured todetermine the orientation of the subject or subjects S included in theimage 110, e.g. horizontal or vertical, and the orientation of the image110, e.g. portrait or landscape. In some embodiments, the orientationdetector 306 is configured to determine orientations by reading theorientation data from metadata 292 of the image 110. In otherembodiments, the orientation detector 306 is configured to determineorientations by using the EXIF camera data, or by using the width andheight of the image 110.

In some embodiments, the orientation detector 306 is configured todetermine the orientations by using image analysis, such as determiningface points and body points of the subject S included in the image 110via depth and position detection. The details regarding depth andposition detection can be found in U.S. patent application Ser. No.13/777,579 entitled “Photography System with Depth and PositionDetection”, which is previously incorporated by reference. In theexample shown in FIG. 12, the required photograph 256 a illustrates anexample landscape photograph including a horizontal subject S, and therequired photograph 256 b illustrates an example portrait photographincluding a vertical subject S.

In some embodiments, the pose detector 308 is configured to determinethe pose, or poses, of one or more subjects S included in the image 110.In some embodiments, pose definition data can be compared with bodypoint position data to determine the pose of a subject, or subjects, S.Pose definition data defines a set of poses by the relative positions ofthe subject's body parts to each other, e.g. pose definition data caninclude a set of standing poses and a set of sitting poses. The posedefinition data differentiates between the standing and sitting poses bythe positions of portions of the body. For example, a standing pose maybe defined by the location of the hips being much higher than thelocation of the knees. Body point position data can be receive from adepth and position detection device, along with digital images includinga skeletal model of the subject or subjects S, and depth images of thesubject or subjects S. The body point and position data can include datathat identifies the locations of subject body points within the digitalimage, and the skeletal model can be formed and visualized by linesextending between the body points and which provide rough approximationsof the skeletal portions of the subject or subjects S. The detailsregarding pose detection can be found in U.S. patent application Ser.No. 13/777,579 entitled “Photography System with Depth and PositionDetection”, previously incorporated by reference.

In some embodiments, the other image features detector 310 is configuredto determine other predefined or user-defined features included in theimage 110. In some embodiments, user-defined features can be receivedvia the session GUI display 280 and communicated to the evaluator 108 bythe graphical user-interface 106. In some embodiments, the other imagefeatures or user-defined features may include hair styles, props,accessories, etc.

In some embodiments, the other image features detector 310 determinesthe other features by reading the other features data from metadata 292of the image 110. In some embodiments, the other image features detector310 determines the other features by using image analysis, such asobject recognition, image processing, computer vision, machine learning,or any of those techniques in combination.

As shown in the example, the image database 290 stores the images 110taken during the photography session and associated metadata 292. Theportrait order specification database 294 can store a plurality ofportrait order specifications 112.

In some embodiments, the metadata 292 can include subject S identifyingdata as well as image data such as date and time of capture, imagefilename and file type, and other image characteristics or imageidentifying data.

FIG. 10 is a flow chart illustrating an example method 400 ofautomatically evaluating and suggesting photographs during a photographysession. In this example, the method 400 includes operations 402, 404,406, 408, and 410.

The operation 402 identifies a portrait order specification 112. Theportrait order specification 112 is associated with a photographysession, and contains at least a list of one or more requiredphotographs 256, each having associated required criteria 258. Furtherdetails regarding an exemplary portrait order specification arediscussed above with reference to FIG. 5. In some embodiments, theportrait order specification 112 can be selected by a photographer Pusing the computing device 142, or the computing device 146, byinteracting with the session GUI display 280 of the session assistant104. For example, the photographer P can select a portrait orderspecification 112 from among a plurality of portrait orderspecifications 112 included in the portrait order specification database294 using user input mechanisms of the computing device 142. In otherpossible embodiments, the portrait order specification may bepreselected or predefined by someone other than the photographer P. Thegraphical user-interface 106 can receive the selection of the particularportrait order specification 112, and can send the portrait orderspecification 112, or can actuate the portrait order specification 112to be sent, from the portrait order specification database 294 to theevaluator 108.

The operation 404 displays the session status report 114 on thecomputing device 142 display via the session GUI display 280. Furtherdetails regarding the exemplary session status reports 114 are discussedabove with reference to FIGS. 6-7. In some embodiments, the sessionstatus report indicates which of the required photographs 256 have beencompleted and which of the required photographs 256 still need to becompleted during the photography session.

The operation 406 captures the image 110. Further details regardingexemplary image capture using the photography station 120 and the mobilephotography system 170 are discussed above with reference to FIGS. 2-3.The image 110 can be stored in the image database 290 in the data store129, and can also be sent to the evaluator 108 for processing. Theoperation 406 can also retrieve the image 110, for example, from theimage database 290. In some embodiments, it may be desired to check if aportrait order specification 112 was completed during a photographysession at some time after the photography session. In such embodiments,the image 110 can be sent from the image database 290 to the evaluator108 for processing.

The operation 408 evaluates the image 110. Further details regardingexemplary image evaluation are discussed above with reference to FIG. 9and the evaluator 108. Evaluation of the image 110 can associate theimage 110 with one or more required photographs 256, determine whetherthe image 110 satisfies the required criteria 258 associated with any ofthe required photographs 256 included in the portrait orderspecification 112 identified in operation 402, determine the qualitylevel of features included in the image 110 with respect to the requiredcriteria 258 and determine a quality score of the image 110, and a rankof the image 110 relative to other images 110 also as associated with arequired photograph 256 in the identified portrait order specification112. In some embodiments, the image 110 can be automatically determinedto satisfy the required criteria of one or more required photographs256, and be designated as qualifying as the required photograph 256 atoperation 408.

The operation 410 updates the session status report 114 on the computingdevice 142 display via the session GUI display 280. Further detailsregarding an exemplary updated session status reports 114 are discussedabove with reference to FIG. 7. Updating the session status report caninclude checking one or more checkboxes 268, displaying an image preview270 as a thumbnail representation of the image 110, listing the imageidentifier 272 of the image 110, and listing the rank 274 of the image110.

In some embodiments, the method 400 can proceed back to the operation406 after completing operation 410, such as if there are requiredphotographs 256 within the portrait order specification 112 without atleast one associated image 110, or if more images 110 are desired.

The operation 412 receives an indication that the image 110 satisfiesthe required criteria 258 for at least one required photograph 256, andthereby qualifies as the required photograph 256. In some embodiments,the indication is received at the computing device 142 through userinput mechanisms, such as those discussed above, using the graphicaluser-interface 106. Further details regarding an exemplary graphicaluser-interface for receiving indications that an image 110 qualifies asone or more required photographs 256 are discussed above with referenceto FIG. 8.

In some embodiments, the method 400 can proceed back to the operation406 after completing the operation 412, such as if there are requiredphotographs 256 within the portrait order specification 112 without atleast one associated image 110, or if more images 110 are desired.

If there is at least one required photograph 256 without an image 110associated with it, or if none of the images 110 are associated with, orsatisfy, the required photographs 256, the operation 414 prompts thephotographer P to take more images during the session. In someembodiments, the prompt can be an indicator, a pop-up dialog box, aflashing symbol or button, or any indicator to indicate to thephotographer P that the session is not complete and there is at leastone required photograph for which none of the images 110 taken duringthe session can satisfy the required criteria or be associated with. Insome embodiments, the prompt can be displayed using the graphicaluser-interface 106. In some embodiments, the operation 414 can includecapturing, or retrieving, one or more additional images 110, such asdescribed above in connection with the operation 406.

In some embodiments, the method 400 can proceed back to the operation408 after completing the operation 414, so as to evaluate the additionalimages 110.

In some embodiments, the operation 400 may be repeated, or alternativelyexecuted as a batch process, for a set of images 110 stored in the imagedatabase 290 at some time after a photography session.

FIG. 11 is a schematic diagram of example required photographs 256captured during a photography session 420 for a particular photographyportrait order specification. In the illustrated example, the requiredphotographs 256 a-f were captured during the photography session 420.The required photographs 256 a-f illustrate certain required criteria.

In the example shown, the required photograph 256 a illustrates a fulllength crop, a full smile facial expression, a portrait image includinga vertical subject orientation, and a seated, casual pose using a stoolprop. In the example shown, the required photograph 256 b furtherillustrates a full-length crop with a different pose without the stoolprop. In the example shown, the required photograph 256 c furtherillustrates a head and shoulders crop with a soft smile facialexpression. In the example shown, the required photograph 256 d furtherillustrates a full-length crop with a no smile facial expression and aone-knee on a chair prop pose. In the example shown, the requiredphotograph 256 e further illustrates similar criteria as requiredphotograph 256 d, but with a full smile facial expression. In theexample shown, the required photograph 256 f further illustrates similarcriteria as required photograph 256 e, but with a three-quarter lengthcrop and no chair prop.

FIG. 12 is a schematic diagram of example required photographs 256captured during a photography session 430 for a particular photographyportrait order specification. In the illustrated example, the requiredphotographs 256 a-b were captured during the photography session 430.The required photographs 256 a-b illustrate certain required criteria.

In the example shown, the required photograph 256 a illustrates afull-length crop, a full smile facial expression, a landscape imageincluding a horizontal subject orientation, and a laying-down, casualpose.

In the example shown, the required photograph 256 b further illustratesa three-quarter crop and a portrait image including a vertical subjectorientation.

FIG. 13 is a schematic diagram illustrating an example remotephotography system 500. The remote photography system 500 includes aphotography station controller 502, and a photography station 504. Thephotography station controller 502 includes a photography stationcontroller web service 506, a photographer computing device 508, and aphotographer P. In the example shown, the photography station 504includes a camera 102, a computing device 142, a lighting controller144, foreground lights 152, background lights 154, a background 156, acamera assembly 524 and a subject S. In some examples, the camera 102can include a camera adjuster 510. The remote photography system 500 canalso include a network 530.

The remote photography system 500 includes a photography stationcontroller 502. The photography station controller 502 is remote fromthe photography station 504. The photography station controller 502 isconfigured to interact with the photography station 504 to perform oneor more photography sessions. In some examples, the photography stationcontroller 502 is located in centralized location remote from aplurality of photography stations 504 and configured to operate witheach of the plurality of photography stations 504.

In the example shown, the photography station controller 502 includes aphotography station controller web service 506. The photography stationcontroller web service 506 is a service which allows the photographer Pto remotely perform and control a photography session and thephotography station 504. The photography station controller web service506 can run on a variety of computing devices including one or moreservers, or the photographer computing device 508. In the example shownthe photography station controller web service 506 is connected to thecomputing device 142 in the photography station 504 and the photographercomputing device 508. In the example shown the photographer computingdevice 508 may send a message to the computing device 142 through thephotography station controller web service 506. In some examples, thephotography station controller web service 506 generates and providesone or more user-interfaces to the computing device 142 and thephotographer computing device 508. Examples of these user-interfaces areillustrated and described in reference to FIGS. 19-21.

Different types of messages can be sent from the photography stationcontroller to the computing device 142. The messages are network datapackets which contain application data for the computing devicesdisclosed herein. In some examples the message packets are controlmessage which cause the computing device 142 to control the imagecapture device 102. In other examples the messages include instructionswhich are provided to the subject S.

In some examples, the photography station controller web service 506contains a computer application which automatically generates messageswhich are delivered to the photography station. These messages can causethe computing device to make adjustments to the camera 102, captures aphotograph using the camera 102, or provide instructions to the subjectS. In some examples the instructions can be audible instructions. Theinstructions can also be visual instructions. In some of these examplesthe photography controller web service may include an artificialintelligence, or machine learning to detect features and perform variousoperations in response.

In the example shown, the photography station controller 502 includes aphotographer computing device 508. The photographer computing device 508allows for the photographer P to communicate with the photographystation 504 and control the camera 102. In the example shown thephotographer computing device 508 is connected to the computing device142 through a network using the photography station controller webservice 506.

The remote photography system 500 includes a photography station 504. Insome examples, the photography station 504 is similar to the photographystation 120, as illustrated and described in FIG. 2. The photographystation 504 can include any scene for photography. One example of thephotography station 504 includes a photography studio which is designedto provide optimal lighting. In some examples, the photography station504 is a mobile studio which can be set up in any of a variety of rooms.For example, the photography station can be indoors, outdoors, or in aprofessional studio.

The photography station 504 operates to capture one or more images ofone or more subjects S, while receiving instructions and controls fromthe photography station controller 502. In some embodiments, thephotography station 504 is controlled remotely by a photographer P, whocan interact with the subject S to guide the subject S to a goodexpression pose, etc., for satisfying the criteria required in theportrait order specification. These instructions, and the controls fromthe camera can be provided remotely through a network, such as theInternet.

In the example shown, the photography station 504 includes a camera 102.The camera 102 is typically a professional quality digital camera thatcaptures high quality images. An example of the camera 102 is describedand illustrated in reference to FIG. 15.

The camera 102 can include a camera adjuster 510. The camera adjuster510 can adjust the camera mechanically, and digitally to capture anideal image of the subject S. An example of the camera adjuster 510 isillustrated and described in reference to FIG. 17.

In the example shown, the photography station 504 includes a computingdevice 142. The computing device 142 is used to receive messages fromthe photography station controller 502 and take various actions based onthese messages. The computing device 142 can connect to the photographystation controller 502 over a network, such as the Internet. In someexamples, the computing device 142 can include the session assistant104. In such embodiments, the computing device 142 and camera 102 formthe hardware implementation of the photography system 100. The computingdevice 142 can include a display which displays the graphicaluser-interface to interact with the subject S. An example of such auser-interface is illustrated and described in reference to FIG. 21.

In the example shown, the photography station 504 includes a lightingcontroller 144. The lighting controller 144 operates, for example, tosynchronize operation of the camera 102 with the foreground lights 152and the background lights 154. Synchronization can alternatively beperformed by the computing device 142 in some embodiments. In someexamples, the controller is connected both to the camera 102 and thecomputing device 142.

In the example shown, the photography station 504 includes foregroundlights 152 and background lights 154, and a background 156. Theforeground lights are arranged at least partially forward of the subjectS to illuminate the subject S while an image 110 is being taken. Thebackground lights 154 are arranged and configured to illuminate thebackground 156. The background 156 is typically a sheet of one or morematerials that is arranged behind a subject S while an image 110 of thesubject S is captured. The foreground lights 152 and background lights154, and a background 156 are illustrated and described greater detailin reference to FIG. 2.

In the example shown, the photography station 504 includes a cameraassembly 524. The camera assembly 524 includes additional hardware tofacilitate some of the embodiments describe herein. The camera assembly524 can include a support device, for example a tripod, to stabilizeimage capture device to create hands free environment for the subjects.Additionally, the camera assembly 524, in some embodiments, includedevices and mechanisms which allow the remote photographer tomechanically control the image capture device.

Also shown is a network 530. The network 530 is used to connect thephotography station controller 502 to the photography station 504. Thenetwork 530 can be a public network, such as the Internet.

In some examples, the photography station 504 is part of a portableequipment kit. For example, the kit can have at least some of the abovehardware, lighting devices, and other professional devices, which can bebrought to and set up at a sight for enabling a remote photographysession.

FIG. 14 is a schematic diagram illustrating an example photographystation 504. In the embodiment shown, the photography station 504includes a lighting controller 144, lights 522, camera assembly 524, andcomputing device 142. The camera assembly 524 includes a camera 102 anda camera adjuster 510. The computing device 142 includes a communicationdevice 528. The data communication network 530 is also shown.

Some embodiments further include of the photography station 504 includea lighting controller 144. The lighting controller 144 operates, forexample, to synchronize operation of camera 102 and the lights 522.Synchronization can alternatively be performed by the computing device142 in some embodiments. An example of the lighting controller 144 isillustrated and described in reference to FIG. 16.

In some examples, the photography station 504 includes lights 522.Lights 522 include one or more lights that operate to illuminate tosubject, background, or a scene. The lights 522 can include one or morelight sources. Examples of light sources include incandescent bulbs,fluorescent lamps, light-emitting diodes, and discharge lamps. Someexamples include one or more foreground lights and one or morebackground lights. Example of lights are illustrated and described infurther detail in reference to FIGS. 2, and 13.

In some examples, the photography station 504 includes a camera assembly524. The camera assembly includes a camera 102, and a camera adjuster510. The camera adjuster 510 makes adjustments to the camera. In someexamples the camera assembly 524 includes additional hardware tofacilitate some of the embodiments describe herein. The camera assembly524 can include a support device, for example a tripod, to stabilizeimage capture device to create hands free environment for the subjects.Additionally, the camera assembly 524 can include devices and mechanismswhich allow the remote photographer to mechanically control the imagecapture device.

The camera assembly 524 includes a camera 102. The camera 102 istypically a professional quality digital camera that captures highquality images. An example of a camera 102 is illustrated and describedin reference to FIG. 14. In some examples the camera is connected to asmart device, which includes audio communication and capture interface.

The camera assembly 524 can also include a camera adjuster 510. Thecamera adjuster 510 is used to make adjustments to the camera 102. Insome examples these, adjustments are mechanical. For example, the cameraassembly 524 is moved either by the camera adjuster 510. In anotherexample, the camera 102 orientation is changed using the camera adjuster510. In some embodiments, the camera adjuster 510 can modify camerasettings. For example, the camera adjuster 510 can modify either opticalzoom or digital zoom. Other examples include changing exposure or focussettings. In some examples the camera adjuster 510 is an applicationwhich runs on a processor on the camera 102. The camera adjuster isillustrated and described in more detail in reference to FIG. 17.

In some examples, the photography station 504 includes a computingdevice 142. The computing device 142 can be directly or indirectlyconnected to the camera 102 to receive digital data. The computingdevice 142 can also be directly or indirectly connected to the cameraadjuster 510 and the lighting controller 144. Direct connections includewired connections through one or more communication cables, and wirelesscommunication using wireless communication devices (e.g., radio,infrared, etc.). Indirect connections include communication through oneor more intermediary devices, such as a lighting controller 144, othercommunication devices, other computing devices, a data communicationnetwork, and the like. Indirect connections include any communicationlink in which data can be communicated from one device to anotherdevice.

The computing device 142 can be any of a wide variety of computingdevices which includes a memory, a processor, and communicationchannels. Examples of computing devices include desktops, laptops,tablets, and smart phones. An example of the computing device isillustrated and described in reference to FIG. 4.

The computing device 142 includes a communication device 528. Thecommunication device is a device which allows the computing device toconnect to a public or private network. Examples include wiredcommunication device, or wireless communication devices. Example ofcommunication devices include Ethernet, USB, Firewire®, Wi-fi®,cellular, Bluetooth®, etc. In the typical embodiment the communicationdevice allows the computing device to connect to a network 530 such asthe Internet.

In some examples, the photography station 504 includes a network 530.The network 530 includes public or private networks. In the commonexample the network allows the computing device to connect to a publicnetwork, such as the Internet.

FIG. 15 is a schematic block diagram of an example camera 102. Thecamera 102 can include a lens 552, a shutter controller 554, a shutter556, an electronic image sensor 558, a processor 560, a memory 562, avideo camera interface 564, a data interface 566, and a camera captureinterface 568.

The camera 102 is typically a professional or high-quality digitalcamera. The camera 102 includes an electronic image sensor 558 forconverting an optical image to an electric signal, at least oneprocessor 560 for controlling the operation of the camera 102, and amemory 562 for storing the electric signal in the form of digital imagedata.

An example of the electronic image sensor 558 is a charge-coupled device(CCD). Another example of the electronic image sensor 558 is acomplementary metal-oxide-semiconductor (CMOS) active-pixel sensor. Theelectronic image sensor 558 receives light from a subject and backgroundand converts the received light into electrical signals. The signals areconverted into a voltage, which is then sampled, digitized, and storedas digital image data in the memory device 562.

The memory 562 can include various different forms of computer readablestorage devices, such as random access memory. In some embodiments thememory 562 includes a memory card. A wide variety of memory cards areavailable for use in various embodiments. Examples include: aCompactFlash (CF) memory card (including type I or type II), a SecureDigital (SD) memory card, a mini Secure Digital (mini SD) memory card, amicro Secure Digital (microSD) memory card, a smart media (SM/SMC) card,a Multimedia Card (MMC), an xD-Picture Card (xD), a memory stick (MS)including any of the variations of memory sticks, an NT card, and a USBmemory stick (such as a flash-type memory stick). Other embodimentsinclude other types of memory, such as those described herein, or yetother types of memory.

In some embodiments, the camera 102 includes three main sections: a lens552, a shutter 556, and an electronic image sensor 558. Generally,electronic image sensor 558 have relatively rapid exposure speeds.However, the process of moving the captured image from the electronicimage sensor 558 to an image storage area such as the memory 562 isslower than the time to acquire the image. Accordingly, in order toreduce the time between acquiring the backlit and front-lit images asdiscussed herein—preferably to further reduce any motion of theforeground object in the time period between shots—some embodimentsinclude an electronic image sensor 558 that is an interline transferCCD. One example of a suitable interline transfer CCD is the modelnumber KAI-11002, available from Eastman Kodak Company Kodak, ofRochester, N.Y. This type of electronic image sensor 558 includes arraysof photodiodes interspaced with arrays of shift registers. In operation,after capturing a first image, photodiodes transfer the electrons to theadjacent shift registers and become ready thereafter to capture the nextimage. Because of the close proximity between the photodiodes andassociated shift registers, the imaging-transfer cycles can be veryshort. Thus, in some embodiments the digital camera 102 can rapidlycapture a first image, transfer the first image to the memory 562 (whereit is temporarily stored) and then capture a second image. After thesequence of images, both of the images can be downloaded to theappropriate longer term memory location, such as a second memory 562.

Since the electronic image sensor 558 continues to integrate the secondimage while the first image is read out, a shutter 556 is employed infront of the electronic image sensor 558. In some embodiments, a shutter556 is used and is synchronized by the processor 560. The shutter 556opens prior to the capture of the first image and remains open for theduration of the second flash. It then receives a signal to close inorder to eliminate further exposure from ambient light. The exposure maybe controlled, shutter 140 in some embodiments.

The lens 552 is located in front of the shutter 556 and is selected toprovide the appropriate photographic characteristics of lighttransmission, depth of focus, etc. In some embodiments, the lens 552 isselected between 50 and 250 mm, with the image taken at a f-stopgenerally in the range of f16 to f22. This provides a zone focus for theimage. It also generally eliminates concerns regarding ambient light.However, it will be appreciated that any number of lenses, focusing, andf-stops may be employed in other embodiments.

In some embodiments, the camera 102 includes a video camera interface564 and a data interface 566. In some examples, the video camerainterface 564 communicates live video data from the camera 102 to thelighting controller 144, and the computing device 142 as shown in theembodiment illustrated in FIG. 14. The data interface 566 is a datacommunication interface that sends and receives digital data tocommunicate with another device, such as the lighting controller 144 orthe computing device 142. The data interface 566 is also used in someembodiments to transfer captured digital images from the memory device562 to another device, such as the controller 144 or the computingdevice 142. Examples of the video camera interface 564 and the datainterface 566 are USB interfaces. In some embodiments video camerainterface 564 and the data interface 566 are the same (e.g., a singleinterface), while in other embodiments they are separate interfaces.

In some examples, the camera 102 includes a camera capture interface568. The camera capture interface 568 interfaces with the cameraadjuster 510, as shown in the example of FIG. 14. In some embodimentsthe camera capture interface receives image capture message from thecomputing device that instructs the camera 102 to capture one or moreimages. In other examples, the camera capture interface receives imagecapture messages from the lighting controller 144 that instruct thedigital camera 102 to capture one or more images. The camera captureinterface 568 can also receive messages to adjust the mechanical ordigital settings of the camera 102. In some embodiments the cameracapture interface is built in as part of the data interface 566.

In some examples, to initiate the capture of the images, the cameracapture interface 568 is used to trigger the capturing of an image. Insome examples the camera capture interface 568 can be used to makemechanical or digital adjustments to the camera. For example, the cameracapture interface 568 can receive inputs which trigger instructions thatwhen executed by the processor 560 adjusts the focus of the camera. Inanother example, the camera capture interface 568 can receive inputswhich trigger the capture of an image.

Although the camera 102 is described in terms of a digital camera,another possible embodiment utilizes a film camera, which capturesphotographs on light-sensitive film. The photographs are then convertedinto a digital form, such as by developing the film and generating aprint, which is then scanned to convert the print photograph into adigital image that can be processed in the same way as a digital imagecaptured directly from the digital camera, as described herein.

FIG. 16. is a schematic diagram of an example lighting controller 144.In the embodiment shown, the lighting controller 144 includes a lightcontrol interface 602, a camera interface 604, a processor 606, acomputer data interface 608, a memory 610, and a power supply 612. Insome examples, the camera interface 604 includes a data interface 614and a video interface 616.

In the embodiment shown, the lighting controller 144 includes a lightcontrol interface 602. Light control interface 602 allows the lightingcontroller 144 to control the operation of one or more lights, such asthe foreground lights 152 and background lights 154, as shown in FIG.13. In some embodiments light control interface 602 is a send onlyinterface that does not receive return communications from the lights.Other embodiments permit bidirectional communication. Light controlinterface 602 is operable to selectively illuminate one or more lightsat a given time. Controller 144 operates to synchronize the illuminationof the lights with the operation of camera 102.

In the embodiment shown, the lighting controller 144 includes a camerainterface 604. Camera interface 604 allows controller 144 to communicatewith camera 102, as shown in FIGS. 13-14. In some embodiments, camerainterface 604 includes a data interface 614 that communicates with datainterface 566 of camera 102 (shown in FIG. 15), and a video interface616 that communicates with video camera interface 564 of camera 102(also shown in FIG. 15). Examples of such interfaces include universalserial bus interfaces. Other embodiments include other interfaces.

In the embodiment shown, the lighting controller 144 includes aprocessor 606 and a memory 610. The processor 606 performs controloperations of the lighting controller 144, and interfaces with thememory 610. Examples of suitable processors and memory are describedherein.

In the embodiment shown, the lighting controller 144 includes a computerdata interface 608. Computer data interface 608 allows controller 144 tosend and receive digital data with computing device 142, as shown inFIGS. 13-14. An example of computer data interface 608 is a universalserial bus interface, although other communication interfaces are usedin other embodiments, such as a wireless or serial bus interface.

In the embodiment shown, the lighting controller 144 includes a powersupply 612. In some embodiments a power supply 612 is provided toreceive power, such as through a power cord, and to distribute the powerto other components of the photography station 504, such as through oneor more additional power cords. Other embodiments include one or morebatteries. Further, in some embodiments the lighting controller 144receives power from another device.

FIG. 17 is a schematic diagram illustrating a camera adjuster 510. Insome examples, the camera adjuster 510 includes a camera adjustmentcontroller 431 and mechanical adjustment components 432. In theembodiment shown, the camera adjustment controller 431 includes a cameracapture interface 434, a mechanical adjustment interface 436, a memory438, a processor 440, a computer data interface 442, and a power supply444. The camera capture interface 434 can include a focus/zoomcontroller 446, and a capture controller 448. The mechanical adjustmentinterface 436 can include orientation control interface 450 and positioncontrol interface 452. In the embodiment shown, the mechanicaladjustment components 432 includes mechanical components 454, electricmotor 456 and environment sensors 458.

In some examples, the camera adjuster 510 includes a camera adjustmentcontroller 431. The camera adjustment controller 431 is used to receivemessages from the photography station controller 502. In some examplesthe messages cause the adjustment controller to make adjustments to thecamera 102 or the camera assembly 524, as illustrated and described inreference to FIG. 14.

In some examples the camera adjuster 510 works within a closed feedbackloop. For, example the camera adjuster 510 may automatically adjust thef-stop or exposure time of the camera to capture an image with arequired lighting ratio. Closed feedback loops included in the cameraadjuster 510 can also be used to control the zoom, lighting, and othermechanical or digital adjustments to the camera or the photographystation. In one example, the photography station includes a gray cardwhich is used to assist with the adjusting of exposure and white balancesettings by the photographer, or a feedback loop included in cameraadjuster 510.

In the embodiment shown, the camera adjustment controller 431 includes acamera capture interface 434. The camera capture interface 434 is usedas an interface between the processor and the image capture device.

In some embodiments, the camera capture interface 434 includes afocus/zoom controller 446. The focus/zoom controller 446 can be used tomodify the focus and zoom of the camera 102. Examples of theseadjustments include, mechanical adjustments to the camera 102 anddigital adjustments to the camera 102.

The camera capture interface 434 can include a capture controller 448.The camera capture interface 434 is used as an interface between theprocessor 440 and the image capture device. The interface can be used tosend a message to initiate the capture of a photograph. In someexamples, the camera capture interface 434 is directed through thelighting controller 144 to synchronize the capture of an image with theflash form the lighting.

In the embodiment shown, the camera adjustment controller 431 includes amechanical adjustment interface 436. The mechanical adjustment interface436 is used to interface between the processor and the mechanicaladjustment components 432.

The mechanical adjustment interface 436 can include an orientationcontrol interface 450. The orientation control interface 450 controlsthe angle of the image capture device. In some examples the camera isadjusted to different angles including up, down right and left.Additionally, the orientation control can include controls for rotatingthe camera. For example, if the camera is not level the processor 440can instruct the mechanical adjustment components 432 to rotate thecamera to capture a level picture through the orientation controlinterface.

The mechanical adjustment interface 436 can include a position controlinterface 452. The position control interface 452 can transferinstructions form the processor 440 to the mechanical adjustmentcomponents 432 which change the position of the image capture device.For example, the processor can instruct to move the image capture deviceto a different location in the photography station.

In the embodiment shown, the lighting controller 144 includes aprocessor 440 and a memory 438. The processor 440 performs controloperations of the camera adjustment controller 431, and interfaces withthe memory 438. Examples of suitable processors and memory are describedherein.

In some examples, the camera adjuster 510 includes a computer datainterface 442. Computer data interface 442 allows, the camera adjustmentcontroller 431 to send and receive digital data with computing device142, as shown in FIGS. 13-14. An example of computer data interface 608is a universal serial bus interface, although other communicationinterfaces are used in other embodiments, such as a wireless or serialbus interface.

In some embodiments a power supply 444 is provided to receive power,such as through a power cord, and to distribute the power to othercomponents of the camera adjuster 510, such as through one or moreadditional power cords. Other embodiments include one or more batteries.Further, in some embodiments camera adjuster 510 receives power fromanother device.

In some examples, the camera adjuster 510 includes mechanical adjustmentcomponents 432. The mechanical adjustment components can be any of avariety of components necessary to make adjustments to the image capturedevice. In some examples mechanical adjustments include any adjustmentto an image capture device except for digital adjustments. In theexample shown the mechanical adjustment components 432 includemechanical components 454, electric motor 456, and environment sensors458 which work together to make mechanical adjustments to the imagecapture device.

In the example shown, the mechanical adjustment components 432 includemechanical components 454. The mechanical components 454 can include anof a variety of components for adjust the image capture device.Including components to switch the lens of a camera, components to movethe cameras location, and components to modify the orientation of theimage capture device.

In the example shown, the mechanical adjustment components 432 includean electric motor 456. The electric motor 456 is used to move theposition or orientation of the camera assembly. The electric motor 456is used in conjunction with the mechanical components to make therequired adjustments.

In the example shown, the mechanical adjustment components 432 includeenvironment sensors 458. The environment sensors 458 are used to assistin the movement, and orientation of the camera assembly 424. Theenvironment sensors 458 can include any sensor which allows thepositioning and movement of the camera assembly 524. Examples of suchsensors include, accelerometer, motion sensors, LIDAR, GPS, one or morecameras, proximity sensors, ambient light sensors, gyroscope, barometer,and any other sensor which provide information about an environment.

FIG. 18 is a schematic diagram illustrating an example remotephotography system 500. The example remote photography system 500 isanother example of the system 500 illustrated and described in referenceto FIG. 13. The example remote photography system 500 includes thephotography station controller 502 and the photography station 504. Inthis example, the photography station controller 502 includes aphotographer computing device 508 with a webcam 482A; a remotephotography application 484 that provides a photographer'suser-interface 485. The example photography station 504 includes acomputing device 142 with a webcam 482B; a photography stationapplication 486 that provides a photography station user-interface 487;and a camera 102. Audible instructions 488 are also shown, as well as aphotographer P and a subject S.

In the embodiment shown, the system 500 includes a photographercomputing device 508. The photographer computing device 508 is remotelyconnected to the computing device 142 over the network 530. In theexample shown the photographer computing device 508 includes a webcam482A. The webcam is configured to capture live video of the photographerwhich is sent over the network 530 to the photography station computingdevice 142. The photographer computing device 508 is an examplephotographer computing device 508 illustrated and described in referenceto FIG. 13.

The photographer computing device 508 is configured to include a remotephotography application 484. The remote photography application includesa video conferencing application and an application to control a cameraremotely to capture one or more photographs during a photographysession. The photographer can provide instructions to the S using thevideo conferencing application on the photographer computing device 508.An example user-interface 485 of the remote photography application isillustrated and described in reference to FIGS. 19-20.

In the embodiment shown, the system 500 includes a computing device 142.The computing device 142 is remotely connected to the photographercomputing device 508 over the network 530. An example of the computingdevice 142 is illustrated and described in reference to FIG. 13.

In the example shown the computing device 142 includes a webcam 482B anda photography station application 486, and audible instructions 488 arealso shown that are presented by the computing device 142. The webcam482B is used to record the subject S during a photography session. Therecording is sent over the network 530 to the photographer who views theimages as part of the video conferencing application. The photographercan provide instructions to the subject S these instructions 488 areplayed using speakers on the computing device 142.

Additional cameras or monitoring devices capturing live video or otherimages from different viewpoints of the photography station can be usedto provide more information to the remote photographer.

The photography station application 486 can include the video conferenceapplication to allow the subject and photographer engage in remoteinstructions related to the photoshoot. An example user-interface 487 ofthe photography station application 486 is illustrated and described inreference to FIG. 21.

A person of ordinary skill in the art would recognize that the videoconference application allows for live feedback to assess the qualityand status of the images captured by the camera 102. Generally,different photography environments have different challenges, such aslighting in an outdoor setting. A video conference application allowsthe photographer, or in some instances an artificial intelligenceapplication, to provide profession solutions for these different,sometimes challenging environments. The video conference applicationallows the photographer to make these adjustments before capturing aphotograph. In some examples, the photographer may be able to take lesspictures on the camera 102 because the video conferencing applicationallows for live feedback. Accordingly, the photographer can ensure theimages captured are of high quality.

Other tools proving real time quality and status of images can also beused as part of the photography station application. Such tools includevirtual reality tools and augmented reality tools. For example, thevideo conferencing application may include virtual objects, guides, orbackgrounds which are provided as visual instructions to the subject S.

In the embodiment shown, the system 500 includes a network 530. Thenetwork 530 can be any type of network which allows the photographer Pto be remote form the photography station. Examples include local areanetworking environment or a wide area networking environment (such asthe Internet).

In the embodiment shown, the system 500 includes a camera 102. Thecamera 102 is another example of the camera 102 illustrated anddescribed in reference to FIGS. 13 and 15.

FIGS. 19-21 are example user-interfaces for the remote photographysystem 500. The FIG's include possible example user-interfaces. Inaddition to many other possible user-interfaces some user-interfacesincluded in this disclosure may include modification which are optimizedto work on different types of computing devices. For example,modifications to the user-interfaces to display the application couldhave a version optimized to run on a smart phone, another on a table,and another on a laptop.

FIG. 19. is an example user-interface 485 for a remote photographer. Inthe example shown, the user-interface 485 includes a live communicationfeed window 702, a photography camera feed window 704, a session statusreport window 706. The example shown also includes a window navigationtab 708 in the session status report window 706, which allows the userto navigate to an adjustments window.

The example user-interface 485 includes a live communication feed window702. The live communication feed window 702 can include a typical videoconferencing user-interface including a live image from the webcam ofthe photography station and a smaller live feed of the photographer.

The live communication feed window 702 is a user interface that allowsthe photographer P to send instruction messages to the computing device142 at the photography station 504. When an instruction message isreceived at the photography station 504 the computing device willcommunicate an instruction to the subject S. In some examples theinstruction message contains an audible instruction and when thereceived at the computing device 142 it causes the computing device 142to play the audible instruction. In other examples the instructionmessage contains a visual instruction and causes the computing device142 to display the visual instruction.

The example user-interface 485 includes a photography camera feed window704. The window 704 can include a live image from the camera 102, asshown in the example of FIG. 13. The image displayed in the window 704provides the photographer P with the feed of what a photograph will looklike once it is captured. In the typical embodiment the photographycamera feed window 704 will display a live feed capturing the subject.In some examples the photography camera feed window 704 includes posinglines to help guide the photographer pose a subject. In one example, thephotography camera feed window 704 has visual instructions which assistthe photographer in completing the photography session.

The example user-interface 485 includes a session status report window706. The session status report window 706 display information related tothe photography session. Including a photo item number, a photocriteria, a preview of the image, an image ID and a rank. The sessionstatus report window includes a wide variety of user-interfaces whichdisplay's general and specific information related to a photographysession. Examples of photography session user-interfaces are illustratedand described in more detail in reference to FIGS. 5-8.

The user-interface 485 can include various customizations and navigationoptions. In the example of FIG. 19 the user-interface includes a windownavigation tab 708. A user can select the tab and navigate which windowis displayed in the related window. Many other view navigations arepossible including bottom bar tabs, top tab menu, list menus,gesture-based navigation, and any other user-interface system whichallows a user to modify one or more windows displayed.

FIG. 20. is an example user-interface 485 for a remote photographer. Inthe example shown, the user-interface 485 includes a live communicationfeed window 702, a photography camera feed window 704, a cameraadjustment window 710. The example shown also includes a windownavigation tab 708 in the session status report window 706, which allowsthe user to navigate to the camera adjustments window. The cameraadjustment window 710 can includes a zoom controller 712, a focuscontroller 714, an orientation controller 716, and position controller718.

The live communication feed window 702 and photography camera feedwindow 704. Are the same live communication feed window 702 andphotography camera feed window 704, as described in detail in referenceto FIG. 19.

The example user-interface 485 includes a camera adjustment window 710.The camera adjustment window 710 provides a user-interface which allowsthe photographer to control the camera 102 (as shown in the example ofFIG. 13). The camera adjustment window 710 can includes a zoomcontroller 712, a focus controller 714, an orientation controller 716,and position controller 718. The camera adjustment window can alsoinclude a capture initiator 720.

The camera adjustment window 710 receives inputs from the Photographer Pwhich generate at least one message which is sent to the photographystation. Examples of messages sent in response to user input using thecamera adjustment window 710 include control messages which are sent tothe computing device 142 at the photography station which cause thecomputing device 142 to instruct the camera 102 or the camera adjuster524 to take an action. Examples of control messages include capturemessages which are sent to the computing device 142 which in turninstructs the camera 102 to capture a photograph. Another example of acontrol message is an adjustment message. An adjustment message cancause the computing device 142 to make a mechanical or digitaladjustment to the camera 102, or the camera adjuster 524.

The zoom controller 712 is used to modify the zoom of the camera 102. Insome examples the zoom controller is used to send at least oneadjustment message to the camera 102, or the camera adjuster 510, whichadjust the optical zoom of the camera. The adjustment message can alsomodify the digital zooms settings. In some embodiments, the zoomcontroller 712 can adjust both optical and digital zoom, and the zoomcontroller 712 includes a sub controller of optical zoom and another fordigital zoom.

The focus controller 714 is used to remotely adjust the focus of thecamera 102. In some examples the focus controller 714 may include anauto-focus option as well as a user-operated control. The Focuscontroller 714 can receive inputs which are sent to the camera adjuster510 or the camera 102, to modify focus of the camera 102. In someexamples, the focus controller is automatic, or the controller includesboth automatic and manual option.

The orientation controller 716 controls the orientation of the camera.The orientation controller 716 can modify the angle of the camera 102.For example, the orientation controller can move the position of thecamera upwards, downwards, right, and left. The orientation controller716 can also rotate the camera 102. For example, the photographer maynotice that the camera is not level and can send an adjustment messageto the orientation controller 716 which with the camera adjuster canrotate the camera to a level position.

The position controller 718 controls the position of the camera. Forexample, the photographer can move the camera assembly 524 to differentlocations in the photography station to take images from differentlocations. In some examples, the position controller 718 can also movethe camera up and down, using the camera assembly 524.

The capture initiator 720 when selected by the photographer P sends acapture message to the camera 102 which causes the camera 102 to capturean image. In some examples, the capture initiator 720 sends one or moremessages to the camera through the camera adjuster 510 or the lightingcontroller 144. In some examples the capture initiator starts acountdown which is visible to one of or both the photographer P and asubject S at the photography station. The countdown gives an indicationof when the photograph will be taken to ensure the photographer P andthe subject S are prepared for the capture to be initiated. In someexamples the capture initiator 720 is automatic. For example, the systemmay detect when the subject is in certain pose, or a certain facialexpression, and automatically capture the image. In some examples, thesystem may automatically capture a photography after the system detectsthat the photograph meets all of the requirement criteria for one ormore photography's in a photography session. In such examples, thesystem may automatically update a portrait order specification for thephotography session.

More control options are possible in the camera adjustment window 710including, shutter control and panning.

The user-interface 485 can include various customizations and navigationoptions. In the example of FIG. 20 the user-interface includes a windownavigation tab 708. A user can select the tab and navigate which windowis displayed in the related window. Shown in FIG. 20 the adjustmentwindow is selected. Many other view navigations are possible includingbottom bar tabs, top tab menu, list menus, gesture-based navigation, andany other user-interface system which allows a user to modify one ormore windows displayed.

FIG. 21 is an example user-interface 487 for a photography station. Theuser-interface includes a live communication feed window 722, aphotography camera feed window 724, and an image reviewer window 726.

The example user-interface 487 includes a live communication feed window722. The live communication feed window 722, in some examples, is atypical video conferencing user-interface. In the example shown thecommunication feed includes a live video of the photographer P in alarge screen and the subject S, who can view the window 722, in asmaller window. Many other communication feed windows 722 are includedin this disclosure including live audio only feeds, and live video feedswith virtual or augmented reality.

The example user-interface 487 includes a photography camera feed window724. The window 724 can include a live image from the camera 102, asshown in the example of FIG. 13. The image displayed in the window 724provides the subject S with the feed of what a photograph will look likeonce it is captured. In the typical embodiment the photography camerafeed window 724 will display a live feed capturing the subject.

The example user-interface 487 includes an image reviewer window 726.The image reviewer window 726 displays a UI which allows the subject toreview the photography session. In the example shown, the window 724displays a grid with the photos taken during the session.

FIG. 22 is a schematic diagram illustrating an example remotephotography system 500. The example shown includes a photography stationcontroller 502 and the photography station 504. The photography stationcontroller 502 includes a photography station controller web service 506and a photographer computing device 508. The photography station 504includes a mobile computing device 730.

The photography station controller 502 includes a photography stationcontroller web service 506, and a photographer computing device 508. Thecontroller 502, web service 506, and computing device 508, operate in asimilar manner as illustrated and described in reference to FIG. 13.

The photography station controller includes a mobile computing device730. In some embodiments of the present disclosure the photographystation is set-up by the subject S using a mobile computing device 730.The mobile computing device 730 includes any of a variety of mobilecomputing devices which include a camera. For example, the mobilecomputing device can be a smart phone, a tablet, or a laptop. In someexamples, the mobile computing device must be able to connect to anetwork to communicate with the photography station controller. Thedevice 730 receives instructions from the photographer P and messagesinitiate the capture of one or more photographs of the subject S.

FIG. 23 is a schematic diagram illustrating an example remotephotography system 500. The example shown includes a photography stationcontroller 502, and a photography station 504. The photography stationcontroller 502 includes a photography station controller web service506. The photography station 504 includes a mobile device 730.

In the example shown the photography station controller 502 includes aphotography station controller web service 506. The photography stationcontroller web service 506 receives live images from the mobilecomputing device 730. The photography station controller web service 506can then detect certain features in the live image and generateinstructions which can be sent to the mobile computing device 730. Insome examples, the instructions are audible. The instructions can alsobe visual, in some examples. The photography station controller webservice 506 can also generate a message which initiates the mobilecomputing device 730 to capture one or more photos of the subject S. Thephotography station controller web service 506 may include artificialintelligence, machine learning, neural networks, or a variety of imageprocessing methods to detect features of an image, provide instructionsand capture images according to a criteria for a photography session.

In the example shown the photography station 504 includes a mobilecomputing device 730 which is connected to the photography stationcontroller 502 remotely through a network. In some examples, the mobilecomputing device 730 connects to a wireless network such as 4G, 5G, andWIFI. The device 730 operates similar to the example of FIG. 22. Thedevice 730 receives one or more instruction messages from thephotography station controller web service 506 which can played audiblyto the subject S. The device 730 also receives a capture message toinitiate capturing one or more photographs.

The photography station 504 includes a mobile computing device andoperates similar to the example of FIG. 22. In this example, the mobilecomputing device receives instructions and messages to capture aphotography from the photography station controller web service 506. Inthis manner the subject S initiates a photography session with themobile computing device 730.

FIG. 24 is a schematic diagram illustrating an example remotephotography system 500. The system 500 includes a photography station504. The photography station includes a mobile device 730 with aphotography station controller 502.

The photography station 504 includes a mobile computing device andoperates similar to the example of FIG. 23. In this example, the mobilecomputing device contains a photography station controller 502 whichwhen executed by the mobile computing device instruct the subject S andcaptures one or more photographs for a photography session. In someexamples the mobile computing device 730 does not need to connect to anetwork because the photography station controller 502 runs thephotography station controller natively. The photography stationcontroller 502 may include artificial intelligence, machine learning,neural networks, or a variety of image processing methods to detectfeatures of an image, provide instructions and capture images accordingto a criteria for a photography session.

FIG. 25 is a schematic diagram illustrating an example remotephotography system 500. The system 500 includes a photography stationcontroller 502 and a photography station 504. The photography stationcontroller 502 includes a photography station controller web service 506and a photographer computing device 508. The photography station 504includes a drone photography device 740.

The photography station controller 502 includes a photography stationcontroller web service 506, and a photographer computing device 508. Thecontroller 502, web service 506, and computing device 508, operate in asimilar manner as illustrated and described in reference to FIG. 13. Inthis example the photographer P controls the drone remotely to captureone or more photographs of the subject S. The photographer P can capturea set of photographs to conduct a photography session.

The photography station 504 includes a drone photography device 740. Thedrone photography device 740 can include a wide variety ofremote-controlled devices with a camera. The device 740 is controlled bythe photographer P who can move around the device 740 to capture one ormore photographs for a photography session. In some examples, the dronephotography device 740 can operate in many ways similar to the camera102 or the camera assembly as illustrated and described in FIGS. 13-14.

FIG. 26 is a flow chart illustrating an example method 760 of conductinga remote photography session. The method 760 can include operations 762,764, 766, and 768.

The operation 762 the photography station is set up. In some examplessetting up the photography station includes the photographer, or acoworker going to the station setting up the station with the componentsthat are illustrated and described in FIG. 13. In other examples thesubject S can set up the photography station. Other examples ofphotography station set ups are illustrated and described in referenceto FIGS. 22-25.

The operation 764 a connecting between the photography station and thephotography station controller is made. In some examples the connectingis made over a public network, such as the Internet, between a computingdevice 142 and photographer computing device 508. The connect allows forthe remote instruction and capture of photographs from the photographystation controller 502. In some examples the connection is with a remotephotographer. In other examples, the connection is with a set ofalgorithms executed as part of a remote photography application.

The operation 766 a photography session is run with a remotephotographer using the photography station controller. Running aphotography session includes giving instructions to help the subjectpose to meet certain criteria and initiate the capture of one or morephotographs. More details of running a photography session are discussedherein. An example method for the operation 766 is illustrated anddescribed in reference to FIG. 27.

The operation 768 products from the photography session are produced.Products include picture products, clothing products, and many othercommercial products which allows for the placement of an image capturedduring the photography session.

FIG. 27 is a flow chart illustrating an example method 766 of running aphotography session using the photography station controller. In someembodiments the method 766 is an example method of the operation 766illustrated and described in reference to FIG. 26. The method 766includes the operations 782, 784, 786, 788, 790, 792, 794, and 796.

The operation 782 a live video image is sent from the photographystation to the remote photography station controller where the liveimages are reviewed by a photographer. In some examples the live imagesare sent over a video conferencing application. In other examples, thelive images are captured by a camera which is used to take the productphotograph at the photography station.

The operation 784 the photographer provides instructions to thephotography station. This can include instructions for a subject to givea certain pose ore move positions. The instructions can include any of avariety of instructions to adjust a scene or a subject captured by acamera in the photography station.

Some examples the photographer can provide instructions to one or moresubjects to position the one or more subjects. Similarly, thephotographer can provide instructions to integrate props into aphotograph. The photographer can provide verbal commands for subjects,and cues, including tones and other similar audio sounds, to notify thesubject to take action or prepare for an image to be captured.

In other examples the photographer receives instructions or cues toassist with the photography session. In one example the photographer canreceive a cue when determination is made that the photography parametersare within the performance window to prompt the remote photographer tocapture the image. A different cue can be provided to the remotephotographer when deviating from the photography session parameters. Inanother example the photographer can receive a cue when a determinationis made that a captured image is of acceptable quality and meetscriteria (for example, pose, crop, facial expression) of a requiredphotograph for the session to prompt the remote photographer to moveonto capturing another required photograph (for example, by providingnew instructions over the channel to change a pose, facial expression,etc.).

The operation 786 adjustments are sent from the photography stationcontroller to a camera assembly. These adjustments include adjusting thecamera settings, focus, zoom, and the cameras position either bylocation or orientation.

Some examples of adjustments which can be sent to the photographystation include adjusting the illumination or the subjects and thebackground, adjusting position and orientation of the camera to capturean image, and adjust lens to minimize distortions. Other examples ofadjustments include controlling mechanical operations of the imagecapture device. For example, sending signals over communication channelto cause the image capture device to move/re-position, focus, zoom, orcapture an image.

The operation 788 the photographer at the photography station controllerinitiates an image capture which is delivered over a network to thecamera at the photography station and captures an image. The capturedimage is then sent back over the network to the photography stationcontroller.

The operation 790 the photographer evaluates the image. In some examplesif the photographer is not satisfied with the image the operations 784,786, 788, and 790 can be repeated until an image is captured whichsatisfies the photographer's requirements. In some examples theoperation 790 includes the operations 408, 410, 412, and 414 illustratedand described in reference to FIG. 10.

The operation 792 the session status report is updated and displayed forthe photographer. Examples of a session status report are illustratedand described in reference to FIGS. 6-7.

The operation 794 the photographer reviews the status report and acceptsthe image or rejects the image. If the photographer rejects the imagethe operations 782-794 are repeated until an image which is acceptableis produced.

The operation 796 the photographer will be prompted to captureadditional images if required for the photography session. In someexamples different photographs meeting different requirements are partof a session. Accordingly, the operations 782-794 are repeated tocomplete the session.

The various embodiments described above are provided by way ofillustration only and should not be construed to limit the claimsattached hereto. Those skilled in the art will readily recognize variousmodifications and changes that may be made without following the exampleembodiments and applications illustrated and described herein, andwithout departing from the true spirit and scope of the followingclaims.

What is claimed is:
 1. A method of instructing and capturing at leastone photograph during a remote photography session at a photographystation, the method comprising: establishing a communication channelwith a computing device of a remote photography station, wherein theremote photography station further includes an image capture device;receiving live images of the remote photography station from thecomputing device; and generating and sending at least one message to thecomputing device over the communication channel instructing thecomputing device to capture an image using the image capture device. 2.The method of claim 1, wherein generating and sending the at least onemessage to the computing device further instructs the computing deviceto make an adjustment of the image capture device.
 3. The method ofclaim 2, wherein the adjustment of the image capture device furtherincludes adjustment of at least one of: (1) a focus setting; (2) a zoomsetting; and (3) an image capture device position setting.
 4. The methodof claim 1, wherein generating and sending the at least one message tothe computing device further instructs the computing device to playaudible instructions.
 5. The method of claim 1, wherein the method isperformed using a software application simulating a photographer, thesoftware application providing the audible instructions to the remotephotography station.
 6. The method of claim 1, wherein generating andsending the at least one message to the computing device furtherinstructs the computing device to display visual instructions.
 7. Themethod of claim 1, the method further comprising: establishing a videoconferencing session with the computing device of the remote photographystation.
 8. The method of claim 1, the method further comprising:evaluating the live images based on at least one required criteria of arequired photograph for the remote photography session; whereinevaluating the live images based on the at least one required criteriaincludes detecting at least one feature in the live images andassociating the at least one feature with the at least one requiredcriteria.
 9. A system for capturing at least one photograph during aremote photography session, the system comprising: a photography stationcontroller including a first computing device; and a photography stationremote from the photography station controller, the photography stationincluding a second computing device and an image capture device; whereinthe first computing device includes a non-transitory storage medium andat least one processor, the non-transitory storage medium storinginstructions that, when executed by the at least one processor, causethe first computing device to: establish a communication channel withthe second computing device; receive live images from the secondcomputing device over the communication channel; and generate and sendat least one message to the second computing device over thecommunication channel to instruct the second computing device to capturean image from the image capture device.
 10. The system of claim 9,wherein the at least one message sent to the second computing devicefurther instructs the second computing device to make an adjustment ofthe image capture device.
 11. The system of claim 10, wherein theadjustment of the image capture device further includes adjustment of atleast one of: (1) a focus setting; (2) a zoom setting; and (3) an imagecapture device position setting.
 12. The system of claim 9, wherein theat least one message sent to the second computing device furtherinstructs the second computing device to play audible instructions. 13.The system of claim 9, wherein the at least one message sent to thesecond computing device further instructs the second computing device todisplay visual instructions.
 14. The system of claim 9, the systemfurther comprising: a first webcam, a first microphone, and a firstspeaker each in data communication with the first computing device; asecond webcam, a second microphone, and a second speaker each in datacommunication with the second computing device; and wherein theinstructions when executed by the at least one processor further causethe first computing device to: establish a video conferencing sessionwith the second computing device of the remote photography station. 15.A non-transitory computer readable storage medium storing instructionsfor remotely conducting a photography session at a photography station,wherein when the instructions are executed by a processor, theinstructions cause the processor to: establish a communication channelwith a computing device of the remote photography station, wherein theremote photography station includes an image capture device; receivelive images of the remote photography station over the communicationchannel; and generate and send at least one message to the computingdevice over the communication channel to instruct the computing deviceto capture an image from the image capture device.
 16. Thenon-transitory computer readable storage medium of claim 15, wherein theat least one message sent to the computing device further instructs thecomputing device to make an adjustment of the image capture device. 17.The non-transitory computer readable storage medium of claim 16, whereinthe adjustment of the image capture device further includes adjustmentof at least one of: (1) a focus setting; (2) a zoom setting; and (3) animage capture device position setting.
 18. The non-transitory computerreadable storage medium of claim 15, wherein the at least one messagesent to the computing device further instructs the computing device toplay audible instructions.
 19. The non-transitory computer readablestorage medium of claim 15, wherein the at least one message sent to thecomputing device further instructs the computing device to displayvisual instructions.
 20. The non-transitory computer readable storagemedium of claim 15, wherein the instructions when executed by theprocessor further cause the processor to: establish a video conferencingsession with the computing device of the remote photography station.